flytesnacks | Flyte Documentation 📖 | Learning library
kandi X-RAY | flytesnacks Summary
kandi X-RAY | flytesnacks Summary
You can find the detailed contribution guide here.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Prepare data preparation .
- Prepare dataframe .
- Train the machine .
- Train a MNIST model on rank .
- A task that trains the horovod model .
- Create a mnist job .
- Creates a custom training task .
- Splits the data into train and validation .
- Generate a pod spec for a task .
- Execute the hyperparameter tuning job .
flytesnacks Key Features
flytesnacks Examples and Code Snippets
Community Discussions
Trending Discussions on flytesnacks
QUESTION
I'm trying to create a Flyte workflow that needs to pass data between several tasks. I looked at one of the examples in the documentation, but trying to recreate the blob-passing as minimally as possible I still can't get it to work.
Here's my workflow definition, in full (my real use case produces a lot more data, of course):
...ANSWER
Answered 2020-Oct-22 at 05:18I am assuming you are running this on a local sandbox environment (you are using minio, which is test blob store that we deploy in the sandbox environment). Can you please share your flytekit.config file that you used to register the workflow.
So Flyte automatically stores intermediate data in a bucket (S3 / GCS) based on how you configure it.
The prefix setting is used to automatically upload the data to the configured bucket and prefix https://github.com/lyft/flytesnacks/blob/b980963e48eac4ab7e4a9a3e58b353ad523cee47/cookbook/sandbox.config#L7
Versions prior to v0.7.0 - the shard formatter setting in the config is used- https://github.com/lyft/flytesnacks/blob/b980963e48eac4ab7e4a9a3e58b353ad523cee47/cookbook/sandbox.config#L14-L17
Please also tell us what version of Flyte you are running. Please join the slack channel and I can help you get started. Sorry for all the troubles
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install flytesnacks
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page